Multilayer Perceptron Training
نویسنده
چکیده
In this contribution we present an algorithm for using possibly inaccurate knowledge of model derivatives as a part of the training data for a multilayer perceptron network (MLP). In many practical process control problems there are many well-known rules about the eeect of control variables to the target variables. With the presented algorithm the basically data driven neural network model can be trained to comply with these a priori rules, making the models more correct and decreasing the amount of required training data. Since the training of the rules is based on statistical error minimization, the rules may be numerically inaccurate or contradictory. This makes the collection and maintenace of the rule bases much less expensive than in rule based expert systems. Currently we are incorporating the derivative based training into a commercial neural network process control tool.
منابع مشابه
Scalability of Parallel Batch Pattern Neural Network Training Algorithm
The development of parallel batch pattern back propagation training algorithm of multilayer perceptron and its scalability research on general-purpose parallel computer are presented in this paper. The model of multilayer perceptron and batch pattern training algorithm are theoretically described. The algorithmic description of the parallel batch pattern training method is presented. The scalab...
متن کاملSizing of the Multilayer Perceptron via Modular Networks
A fast method for sizing the multilayer perceptron is proposed. The principal assumption is that a modular network with the same theoretical pattern storage as the multilayer perceptron has the same training error. This assumption is analyzed for the case of random patterns. Using several benchmark datasets, the validity of the approach is demonstrated.
متن کاملFeature Selection Using a Multilayer Perceptron
The problem of selecting the best set of features for target recognition using a multilayer perceptron is addressed in this paper. A technique has been developed which analyzes the weights in a multilayer perceptron to determine which features the network finds important and which are unimportant. A brief introduction to the use of multilayer perceptrons for classification and the training rule...
متن کاملAn Active Learning Algorithm Based on Existing Training Data
A multilayer perceptron is usually considered a passive learner that only receives given training data. However, if a multilayer perceptron actively gathers training data that resolve its uncertainty about a problem being learnt, sufficiently accurate classification is attained with fewer training data. Recently, such active learning has been receiving an increasing interest. In this paper, we ...
متن کاملArtificial Metaplasticity can Improve Artificial Neural Networks Learning
Metaplasticity property of biological synapses is interpreted in this paper as the concept of placing greater emphasis on training patterns that are less frequent. A novel implementation is proposed in which, during the network learning phase, a priority is given to weight updating of less frequent activations over the more frequent ones. Modeling this interpretation in the training phase, the ...
متن کامل